Journal article
On explicit form of the stationary distributions for a class of bounded markov chains
S McKinlay, K Borovkov
Journal of Applied Probability | CAMBRIDGE UNIV PRESS | Published : 2016
DOI: 10.1017/jpr.2015.21
Abstract
We consider a class of discrete-time Markov chains with state space [0, 1] and the following dynamics. At each time step, first the direction of the next transition is chosen at random with probability depending on the current location. Then the length of the jump is chosen independently as a random proportion of the distance to the respective end point of the unit interval, the distributions of the proportions being fixed for each of the two directions. Chains of that kind were the subjects of a number of studies and are of interest for some applications. Under simple broad conditions, we establish the ergodicity of such Markov chains and then derive closed-form expressions for the stationa..
View full abstractGrants
Awarded by ARC
Funding Acknowledgements
This research was supported by the ARC Centre of Excellence for Mathematics and Statistics of Complex Systems, the Maurice Belz Trust, and ARC Discovery Grant DP120102398. The first author wishes to thank the School of Mathematical Sciences at Queen Mary, University of London, for providing a visiting position while this research was undertaken. The authors are grateful to the anonymous referee whose comments helped to improve the exposition of the paper.